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BETWEEN TEACHER DISCRIMINATION AS THE BASIS 
FOR ANALYZING CLASSROOM INTERACTIONS. 



The purpose of this study was to develop an empirical method 
for analyzing and reporting classroom interaction data. 

Over the last two decades, educational researchers have 
complained about problems in obtaining reliable and general izable 
summaries of classroom interaction data (McGaw, Wardrop, & Bunda. 
1972). Gilmore, Kane, & Naccarato (1978) and Erlich & Borich 
(1979) presented methods for describing teacher behaviors based 
on general*- ,)ility theory (Chronbach, Gleser, Nanda, & 
Rajaratnam, 19/2) to the operational definition of teacher 
behavior variables. Their efforts served to highlight the 
problem, but a direct application to large sample studies with 
many correlated observations appears to be impractical 
particularly when research hypotheses are multivariate or use 
classroom interactions as dependent variable. 

One notable contribution was made by Brown, Mendanhall, it 
Beaver (1968) who argued that the true test of a reliability 
estimate was the a measure of the consistency with which teachers 
could be discriminated from one another. The present study drew 
upon their perspective by attempted to using discriminating power 
as the basis for combining observation variables into orthogonal 



dimensions of classroom distance. Classroom differences were 
operational i zed as the canonical discriminant functions of 
observation variables used to discriminate between teachers. 



Methods and techniques 



Data was collected according to a modification of Blosser's 
classroom observation scheme involving the frequency of various 
interactions (question, answer, or management), the cognitive 
level of the interaction, the role of the actor, the level of 
personalization, and the length of the interaction in words 
(Table 1). Data were summarized by counting the numbers of 
interaction that occurred in a standard ten-minute class segment. 
The nineteen variables were available for each of six class 
segments per teacher were used to conduct a stepwise discriminant 
analysis of between-teacher differences iind, subsequently, to 
develop segment scores on the basis of the discriminant scores. 
The structure matrix of correlations between the discriminating 
variables and the discriminant function was rotated to the 
varimax criterion to facilitate interpretation. 



Insert Table 1 



Tape recordings made of 24 upstate New York high school 
biology and chemistry class on six different occasions during the 
19B5-19B6 school year were analyzed by a panel of expert judges. 
Each interaction in the randomly selected ten minute period was 
classified and the interactions were accumulated. 
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TABLE 1: 



Variables included in the between-teacher discriminant 
analysis of classroom discourse- 



Variable 



Description 



Actor 
TEACH 
STUDENT 

Action 
ACT1 
ACT2 
ACT3 
ACT4 
ACTS 

Question Type 
QUES1 
QUES2 
QUES3 
QUES4 
QUES5 

Answer type 
ANSI 
ANS2 
ANS3 
ANS4 

Student named 
NAMED 

Length of answers 
MEANLEN 
SDLEN 



Teacher Initiator CNo = 0, Ye« =11 
Student Initiator tNo = 0, Yes = 13 



Question 
Student Answer 

Teacher Response to Student Answer 
Discussion Management 
Classroom Management 



Memory-recal 1 
Low Convergent 
High Convergent 
Di vergent 
Evaluative 



Direct 
Inflected 

Student doesn't know answer 
Chorus Answer 



Student's name used CNo « 0, Yes =13 



Mean Length of Student Answers 
Standard Deviation of Answer Length 
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Res ul ts 



A stepwise discriminant function, based on Milks" lambda 
criterion, used 17 variables and provided statistically 
significant between-teacher discrimination (Milks' lambda«0.0039; 
Chi-squar«d«681.80j df«368; p_<0.001) . The associated canonical 
correlation was 0.80 and accounted for 76. 9X of the between- 
teacher variance. Six functions, before rotation, were 
statistically significant (p<0.01). 

An examination of the rotated structure matrix (TABLE 2) of 
correlations between the discriminating variables and the 
canonical discriminant functions suggests that the first function 
was a measure of the frequency of low-level recitation. High 
scores were correlated with many questions (r=0.67), teacher talk 
(0.67), student answers (.66), memory /recal 1 questions (0.63), 
teacher responses to student answers (0.39), direct answers 
(0.55), student talk (0.51), and chorus answers (0.35). 

Insert Table 2 

The second function differentiated teachers who had classes 
marked by lengthy student answers (r«0.71), answers of varied 
length (0.57), frequent inflected answers (0.42), and convergent 
questions (0.40). It was judged to be a measure of problem- 
solving to application discussions. 
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TABLE 2: 



Rotated correlations between discriminating classroom discourse 
variables and canonical discriminant functions 

(Variables ordered by size of correlation within function) 



Discriminant Function 



Variable 

ACT1 

TEACH 

ACT2 

QUES1 

ACT3 

ANSI 

STUDENT 

ANS4 

MEANLEN 

SDLEN 

ANS2 

QUES3 

ACT5 

NAMED 

QUES2 
QUES4 

ANS3 

ACT4 
QUESS 



FUNC 1 


FUNC 2 


FUNC 3 


FUNC 4 


FUNC 5 


FUNC 


. 67* 


. 13 


-,02 


.08 


-.09 


-. 13 


.67* 


. 15 


.01 


.05 


.05 


.08 


.66* 


.03 


.04 


.02 


. 15 


-. 14 


.63* 


-.06 


.02 


-.16 


-.06 


.32 


.57* 


-.01 


-.02 


. 15 


.02 


.02 


.55* 


.11 


.04 


-.11 


.23 


.28 


.51* 


. 19 


-. 14 


-.08 


-.02 


.28 


.35* 


.00 


-.27 


.12 


-.27 


.05 


.03 


.71* 


-.03 


-.07 


-.04 


. 13 


.20 


.57* 


.04 


. 10 


.00 


-.02 


-. 13 


-42* 


.36 


.21 


. 13 


.08 


.07 


.40* 


.05 


-.01 


.26 


.02 


.09 


. 17* 


-. 17 


-. 12 


-.11 


. 14 


. 10 


.09 


.72* 


-.20 


.01 


. 10 


. 11 


.01 


-.09 


.41* 


-.07 


.08 


-.01 


.03 


-.01 


.36* 


.17 


-.07 


.07 


.06 


.04 


-OS 


.44* 


-.02 


. 17 


. 16 


-.01 


-.06 


.06 


.41* 


.07 


.03 


-.11 


-. 19 


. 14 


-.34* 
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The third function was correlated with only one 
discriminating variable, frequent use of student names <r«=0.72>. 
It was regarded as a measure of personalization. 

The fourth function was correlated with the frequency of low 
convergent <r«0.41> and divergent (0.36) questions. It was 
regarded as movement to higher level discussion. 

The fifth function was correlated with a single discourse 
variable, frequence that the student did not know the answer 
<r=0.44>. It was labeled does not know and could be a reflection 
of the level of student knowledge or in the teacher's questioning 
ability. 

The final function was a measure of class attempts to 
structure discourse and was related to the frequency of 
discussion management 'nteractions <r~0.41) and low levels of 
evaluative questions (-0.34). 

Scientific implications 

This analysis indicated that classroom observation variables 
could be grouped into scales that discriminated between teachers 
and the the scales were meaningful. Since the functions 
accounted for a striking proportion of the between -teacher 
variation and were statistically significant, while retaining a 
high degree of interpretability, such an analysis provides a 
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useful approach to empirically summarizing classroom obcervati 
schemes consistent with the concept of between-teacher 
reliability. 



REFERENCES 



Brown, B.R. , MendenhMl,W. Beaver, R. (1968) The reliability of 
observations of teachers* classroom behavior. Journal of 
Experimental Education , 36 . 1-10. 

Cronbach, L.J., Gleser, G.C. , Nanda,H., & Rajaratnam, N. (1972) 
IhS. PgPgndabUHv Bl Behavioral Measurements! The Theory gf. 
General j gab HtV fjBSL Scores and. Profiles . New York* Wil*y. 

Erlich, 0. & Borich, G. (1979) Occurrence and general i*abi 1 ity 
of scores on a classroom interaction instrument. Journal of 
Educational Measuremen t r J£, 11-18. 

Gill more, 6.M. , Kane, M.T. , & Naccarato, R.W. «. 978) The 
general izabil ity of student ratings of instruction! 
Estimation of teacher and course components. Journal of 
Educational Measurement . UJ, 1-13. 

M=Gaw, B. , War drop, J.L. , & Bund*, M. A. (1972) Classroom 
observations schemes t Where are the Errors. American 
Educational Research Journal . 9, 13-27. 

Norusis,M.J. (1986). SPSS/PC+ Advanced Statistics. Chicago: SPSS 
Inc. 



10 



